Optical control system with modulated emitters

ABSTRACT

An optical control system is described, which employs a series of optical emitters and detectors arranged about a touch area. The emitters are driven by a series of orthogonal functions, and the system is operable to correlate the signals received at the detectors with the modulation functions to determine the amount of energy received by the detectors from each of the emitters. This system means that all or many emitters can be modulated simultaneously, so the scanning process is accelerated. Also, the energy estimates arrived at by correlation with the modulating functions are largely unaffected by external interference signals as well by each other. An additional benefit of the present invention is that the correlation processing makes use of many detector samples and tends to yield results which have higher resolution than the sample values themselves, due to the averaging of noise over the sample set.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.13/524,823, filed Jun. 15, 2012, which application is a continuation ofU.S. application Ser. No. 13/059,772, filed Feb. 18, 2011, now issued asU.S. Pat. No. 8,227,742, which is a national stage entry ofPCT/EP2009/005739 filed Aug. 7, 2009, which claims priority to IrishPatent Application S2008/0651 filed on Aug. 7, 2008. The subject matterof all of the foregoing is incorporated herein by reference in theirentirety.

BACKGROUND

1. Field of the Invention

This invention relates to optical control systems and devices, forexample, touch sensitive displays and touch sensitive overlays fordisplays.

2. Description of the Related Art

In a traditional optical touch overlay, optical emitters and detectorsare arranged along opposing edges of a rectangular touch sensitive area.An orthogonal grid is formed by the optical beams between the emittersand the corresponding detectors over the touch sensitive area. The beamsare scanned in sequence to determine if the path loss indicates thatthere is an object (such as a finger or a stylus) interrupting ormodulating any of the beams.

The touch sensitive area may be an optically transparent planarwaveguide through which the beams pass by total internal reflection, ora surface over which the beams pass in close proximity to the surfaceand substantially parallel to the surface.

In the case of a waveguide, the material used can be a transparent sheetof plastic or glass. An object such as a finger or a stylus coming intocontact with the transparent waveguide will have a higher refractiveindex than the air normally surrounding the waveguide. The increase inrefractive index will disrupt total internal reflection of light energyat the interface between the waveguide and the touching object, causingincreased light leakage from the waveguide over the area of contact.This leakage attenuates any beams passing through the position of thetouch event. Correspondingly, the removal of the touching object willcause the attenuation of the passing beams to be reduced as will bedetectable at the output of the associated detectors.

In the present specification the term “light” includes IR and UVradiation, and the term “optical” is to be interpreted accordingly.

When the touch sensitive area is a surface over which the beams pass, anobject which is not optically transparent at the wavelength in use willattenuate or interrupt the beams passing through the object location.

This is illustrated in FIG. 1, where an opaque object 10 at position Tattenuates a beam 12 between an emitter 14 on the left side of a touchsensitive area 16 and a detector 18 on the right side of the touch area16. The opaque object 10 also interrupts a beam 20 between orthogonalaxis emitters 22 and the corresponding detectors 24.

Scanning logic circuitry associated with the emitters and detectors candetermine the intersection point of one or more interrupted beam pathsand deduce the position of the interrupting object. The object must belarge enough to detectably attenuate at least one beam in one axis andat least one beam in the orthogonal axis.

Such a panel traversed by optical paths can, in addition to thedetection of touch events, detect the operation of mechanical controldevices arranged along the optical paths. For example, a mechanicalbutton control may be inserted along an optical path whereby the buttoncontrol presents a minimal attenuation to optical energy when the buttonactuator is in its resting position, but introduces significant opticalattenuation when the button actuator is pressed. This may beaccomplished by introducing an opaque vane into the optical path whenthe button is pressed. Various mechanical designs for control devicesmay be used to modulate the optical energy passing along the opticalpaths such that the status of such control devices can be detected byprocessing the signals from the optical detectors.

The use of amplitude modulation of optical emitter outputs in opticaltouch and related optical control systems is well known. Typically, aspecific frequency of modulation is chosen which can readily beseparated from unwanted signals at the detector output by narrowbandfiltering. This modulating signal can be applied to an emitter by usingit to modulate the current flowing through the emitter, which is usuallybe a current controlled device such as an LED.

However, optical emitter and detector response times (often tens ofmicroseconds for detectors) and the need to be distant in frequency fromthe harmonics of mains-powered light sources limit the range of usablefrequencies in low cost applications, so most devices using airborneoptical transmission have optical emitters which are amplitude modulatedby a fixed frequency in the 30 kHz to 80 kHz range.

Therefore, any device using optical detectors may receive externalinterference originating from other devices with emitters radiatinglight of a similar wavelength which is modulated by a similar range offrequencies.

Optical scanning devices normally activate emitters (modulated orunmodulated) in a sequential manner, so that the signal at one or moreactive detectors can be associated with a known source emitter. Thisprolongs the scanning process, particularly if modulation needs to bedetected for each emitter signal to be determined reliably.

The invention provides an optical control system comprising:

a plurality of optical emitters and a plurality of optical detectorsdefining therebetween an area of optical paths whereby the transmissionof energy between an emitter and a detector may be modulated by anoptical interaction occurring in the vicinity of said area, wherein atleast one of said detectors is positioned to receive optical energy frommore than one of said optical emitters;

drive circuitry for driving a plurality of said optical emitterssimultaneously according to a modulation scheme in which each emitter ismodulated with a different modulation function, said functions beingorthogonal relative to one another;

correlation means associated with said at least one detector forreceiving an output therefrom and correlating said output with at leastthose modulation functions driving those emitters which said at leastone detector is positioned to receive optical energy from, to therebydetermine the amount of energy incident on said at least one detectorfrom each of said emitters.

In the present invention, functions which are orthogonal to one anotherare used to amplitude modulate the emitter devices, with one orthogonalfunction allocated to each emitter. Preferably, each modulating functionhas a broad frequency spectrum and a strongly non-periodic nature in thetime domain so that it will not correlate well with interferencesignals, which are typically periodic.

In the present specification the term “orthogonal” refers to any twochosen functions from a family of “orthogonal” functions having zerocross-correlation.

Preferably, each modulating function has just two values over time sothat digital control of the emitter may be used for simplification ofthe associated circuitry and processing. The depth modulation applied tothe emitter may be any value from greater than 0% up to 100%.

There exist families of complex functions which are orthogonal to eachother. If each emitter in a group of emitters is allocated a functionfrom an orthogonal family of functions, the emitters may besimultaneously modulated by their respective functions but the energyfrom each emitter arriving at a given detector will still be measurableseparately. By correlating the output from a detector which receives thecomposite energy from at least one emitter with each of the modulationfunctions in use, the resulting correlation values are accurateestimates of the energy received from the emitter associated with eachmodulation function.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will now be further described by way of example only withreference to the accompanying drawings, in which:

FIG. 1 (previously described) is a schematic illustration of a knownoptical touch detection system;

FIG. 2 is a block diagram of an optical control system;

FIG. 3 is a diagram which illustrates the wave forms associated with afamily of orthogonal functions such as may be used to drive the emittersof the system of FIG. 2;

FIG. 4 is a diagram which illustrates strong and weak correlationsbetween detector outputs and an interference source;

FIG. 5 is a table of 16-bit words for use in driving a set of 16emitters with reduced power requirements;

FIG. 6A is a flowchart of operation of a method for use in interpolatinga noise value during operation of the system of FIG. 2;

FIG. 6B is a waveform diagram illustrating how the method of FIG. 6A canbe applied in practice; and

FIG. 7 is a flowchart of a method for selecting a set of modulationfunctions or codes.

FIG. 2 shows the hardware sections of an optical control system. Themicroprocessor 26 writes emitter modulation patterns to the emitterregister 28 under software control. The sample values for at least oneof the emitters 30 are written at the start of every sample interval.The beams 32 travel across the touch sensitive area 34 and, if notinterrupted by an opaque object, arrive at a detector 36. The analoguemultiplexer 38 selects the analogue output of one detector 36 asdirected by the value in register 40 and routes it to theanalogue-to-digital converter 42 for conversion into numeric form forprocessing by the microprocessor 26. The analogue multiplexer 38 mayselect the outputs of more than one detector during a single sampleinterval.

The touch sensitive area 34 can be an optically transparent planarwaveguide through which the beams pass by total internal reflection, ora surface over which the beams pass in close proximity to the surfaceand substantially parallel to the surface, to give two examples. Theemitters and detectors are shown as two simple arrays on opposite edges,but in practice, emitters and detectors may be arranged around theentire perimeter of the surface (e.g. all four edges of a rectangularsurface) to maximise the resolution of, the touch sensitive system.

The current drawn by the emitters 30 when they are radiating willusually be substantial and it is advantageous to minimize the time forwhich the emitters 30 are active. Therefore, it may be efficient in adevice with current limitations for the microprocessor 26 to update theemitter register 28 at the start of every sample period and to controlthe analogue multiplexer 38 by means of register 40 such that thesignals from more than one detector 36 are routed to theanalogue-to-digital converter 42 in rapid succession and the resultingsample values written to RAM 44 for processing later. Before the firstanalogue-to-digital conversion can be performed by the converter 42 in agiven sample interval, there may need to be a pause corresponding to atleast the response times of the emitters 30 and the detectors 36. Whenthe sample and store process is complete for all of the detectors 36,the sample period can end and the next sample period can commence withthe updating of the emitter register 28. At least one digital sample ofthe output of the detectors 36 is required for every update of theemitter register 28. When there has been a sample interval with anemitter update and sample acquisition for each bit of the modulatingfunctions, the emitters 30 can all be rendered inactive by thecontrolling software and the sample values in the RAM 44 can becorrelated with the modulating functions.

The use or a family of orthogonal modulation functions in the presentinvention means that all or many emitters can be modulatedsimultaneously, so the scanning process is accelerated. Also, the energyestimates arrived at by correlation with the modulating functions arelargely unaffected by external interference signals as well by eachother. An additional benefit of the present invention is that thecorrelation processing makes use of many detector samples and tends toyield results which have higher resolution than the sample valuesthemselves, due to the averaging of noise over the sample set.

A given family of orthogonal functions will have a minimum period overwhich the member functions of that family are fully orthogonal. Thatminimum period will typically be a number of samples which is a power oftwo. There will be more functions in an orthogonal family when thenumber of samples is increased (i.e. a longer code length is used),permitting more emitters to be simultaneously active. However, longcodes will also incur a longer scanning time for a given modulationrate. Ideally, the shortest code length which provides an orthogonalmodulation function for each emitter in a group (where a group might beall of the emitters in a system or might be the emitters relating to anX or Y axis) would be used.

In selecting modulation functions from a family of orthogonal functions,some may be more desirable than others. For example, the families ofWalsh functions are families of mainly complex orthogonal functionswhere each has only two values over time, but some members are purelyperiodic i.e. they are square waves with a constant period. Thenon-periodic functions are to be preferred since the functions usedpreferably have the broad spectrum mentioned above. However, thisconstraint reduces the number of family members which can be used for agiven code length.

FIG. 3 shows an example family of orthogonal functions with a codelength of 16 samples. The cross correlation of any of these functionswith any other function in the family is zero over the code length.

Function numbers 3, 4, 7, 8, 9, 10, 11 and 12 have been marked with anasterisk to indicate that these are preferable to the other familymembers because they are non-periodic. (Even so, functions 4 and 12 arestill not ideal, as they have only one phase change and are thereforesubstantially periodic.)

In an additional aspect of the invention, the emitter on and off periodsare varied in a complex manner. This permits the use of periodicmodulation functions. The sampling of the detectors must be variedsimilarly so that the sample values presented to the correlationprocessing will be essentially unaffected by the timing variations. Thetiming variations can be derived from a complex function such as apseudorandom sequence and the variations are applied globally so thatall emitters change state at the same time and all detectors are sampledat approximately the same time (the use of a multiplexedanalogue-to-digital converter means that they cannot be sampled trulysimultaneously)

An external interference signal is likely to be modulated in a periodicmanner and

FIG. 4 shows that it is possible that it will correlate with a periodicemitter modulation function of similar frequency and phase. Function 13in FIG. 4 is the modulation function 13 from the family of functionsshown in FIG. 3. Function 13 of the example family is periodic and thetransition between samples is marked with an arrow. It will be evidentfrom the diagram that the external periodic interference signal shown isof similar frequency and phase to function 13 and would correlatestrongly with function 13.

In accordance with this additional aspect of the present invention,function 13′ in FIG. 4 has the same sequence of values as function 13,but the timing between the application of the function values to theassociated emitter is varied and inconsistent. The transition betweensamples is again marked with an arrow. The detector sampling is variedin the same way so the correlation with the emitter modulation functionswill be unchanged while the correlation with external periodicinterference signals, which are similar in frequency to the nominalfrequency of the modulating function, will be significantly reduced.

This timing variation can be applied even if only non-periodic emittermodulation functions are being used, so that the spectral components ofthe emitter modulation function are spread in frequency around theharmonics of the nominal modulation frequency. This will increase therejection of typical interference signals, particularly when short codelengths are used.

In another aspect of the invention, members of a family of orthogonalfunctions may be chosen such that the number of emitters active at anystage during the length of the codes is limited to a maximum number.Without applying this criterion, many combinations of orthogonalfunctions will result in at least one step in the code length where allor all but one of the emitters are active.

If the code length is large, the number of available orthogonalfunctions may be large—tens of thousands for a 32-bit code length—anditerative methods can be used to select functions with the minimumnumber of simultaneous ‘1’ or ‘0’ values (whichever value corresponds toan emitter being activated).

FIG. 5 lists a set of values (in decimal and binary) for modulating 16emitters with every bit in the binary representation word assigned to anemitter and with modulating functions of 32 bits in length. A given bitposition in each of the 32 words represents the values of one orthogonalfunction. The set of values listed is suitable for driving emitterswhere an emitter is activated by a ‘1’ value in the corresponding bit ofeach 16-bit word. None of the functions listed are periodic.

Thus, for each emitter, the sequence of values used to drive the emitterthrough a series of 32 “on” or “off” states is found by reading down thecolumns. Each row is a 16 bit word used to drive the 16 differentemitters to the on or off state represented by a different position. So,for example, the first word (decimal 19418=binary 0100101111011010) iswritten to the register at the start of the first sample interval anddetermines that each of the first, third, fourth, sixth, eleventh,fourteenth and sixteenth emitters is driven to an “off” state, while theremaining emitters are driven to the “on” state during this first sampleinterval. The emitter states for the second sample interval aredetermined by the second row (decimal 40557=binary 1001111001101101),switching the first emitter on, the second emitter off, leaving thethird emitter on, and so on.

The functions used to generate the list shown in FIG. 5 have beeniteratively selected to minimise the number of emitters active at anytime. In the case of the functions listed, there is no word which wouldactivate more than 11 emitters at once. An advantage of this aspect ofthe invention is that it reduces the dynamic range of the light levelsreceived at a detector. This can be translated into an improvedsignal-to-noise ratio in the signal acquired by the A/D converter usedto digitize analogue detector outputs. An additional advantage of usingfunctions selected in this way is reduced peak current demand caused bythe relatively high operating current drawn by the emitters and reducedvariation in current demand (power line noise) over the code length.

In some applications, it may also be advantageous to select functionswhere the minimum number of emitters that would be simultaneously activeis large, so that the variation in light level at a detector and thevariation in current consumption is kept to a minimal value. With theexample functions shown in FIG. 5, there are never fewer than 3 emittersactive at a time, so the range of light levels at the detectors willvary between the output of 3 emitters and the output 11 emitters,assuming none of the beams are interrupted. This may also beadvantageous in other circumstances, such as where the detectors arephototransistors, a minimum illumination level biases thephototransistors into a relatively linear part of their characteristiccurve.

In yet another aspect of the present invention, more than the requisitesingle sample of a detector output is acquired during a sample interval.At least one of the additional samples taken is acquired with theemitters inactive.

The taking of additional samples when the emitters are inactive is wellknown for the purposes of ambient light compensation. However, it isalso advantageous to take such samples with a precise timingrelationship to the modulation of the emitters to minimize the effectsof rapidly modulated interference as well as ambient light. This can beaccomplished by acquiring samples of the detector output before andafter the emitters are active for a given step of their emitterfunctions.

FIG. 6 a shows an example of a sampling sequence in accordance with thisadditional aspect of the present invention. The timescale shown coversone bit period in the length of a code. First, the emitters are forcedoff and a sample is taken when the detectors have settled at theresulting light level. The sample value acquired will be determined bythe amount of external light which is effectively unmodulated, such assunlight, and the amount of modulated light, such as incandescent light,which is incident upon the given detector. A second sample is takenduring the emitter activation period. It is during this time that thevarious functions allocated to each emitter specify whether thecorresponding emitter should be activated or not for this bit period.FIG. 6 b shows an example of a bit period where at least one of theemitter functions dictates that the associated emitter is to beactivated. A third sample is taken after the emitter has been turned offafter the emitter activation period.

If the ‘before’ and ‘after’ samples are acquired with a known timingrelative to the ‘during’ sample (when the emitters are emitting or notas determined by the current phase of their corresponding modulationfunctions), an intermediate estimate of the ‘during’ sample with theemitters off can be interpolated. If the time between the ‘before’ and‘during’ samples and the ‘during’ and ‘after’ samples is the same, theinterpolation is simply the sum of the ‘before’ and ‘after’ samplevalues divided by 2. This interpolated value can be subtracted from theactual sample acquired during the emitter activation time to compensatefor ambient light and interference of low frequency relative to thesample rate.

Preferably, the interval between all three samples is short relative tothe modulation rate of typical interferers.

A useful value can be derived from the ‘before’ and ‘after’ samples whenthe difference between them is calculated. This gives an approximatemeasure of the noise and interference present at frequencies which arehigh relative to the sampling rate. This noise estimate canadvantageously be used to generate alarms or inhibit the generation ofscan data if the amount of noise and interference is excessive (meaningthe scan data is of dubious quality).

By comparing the noise estimate with the results of the correlationprocess, the signal-to-noise ratio of the signal at a detector can beestimated for each emitter. This can be used to control the emitterpower as described in our co-pending specification (PCT applicationclaiming priority from Irish Patent Application S2008/0653).

When sampling rapidly and with fixed timing, the ‘before’ sample of onefunction bit period may be the ‘after’ sample of the previous bitperiod.

FIG. 7 is a flowchart showing one way of generating a set of modulationfunctions. A set of aperiodic sequences of the required length isgenerated and tested for mutual orthogonality. The number of ones and/orzeroes in each position is checked across the set of sequences. If athreshold has been set (e.g. no more than 11 ones in the same positionin each of 16 sequences) then a comparison is made with this threshold,and additional candidate sequences are substituted until the thresholdis met. If no threshold has been set, the process continues bydiscarding and replacing sequences until an optimal solution is reached.

Alternatively, one could generate families of mutually orthogonalsequences and, within each such family, select the required number offunctions (e.g. 16 functions to drive a group of 16 emitters) based onthe optimal solution in terms of highest minimum number of simultaneous“off” states and/or lowest maximum number of simultaneous “on” states.This could be repeated for several such families of mutually orthogonalfunctions up to and including exhaustively testing all such sequences oflength N to find the optimal solution.

The invention is not limited to the embodiment described herein but canbe amended or modified without departing from the scope of the presentinvention.

What is claimed is:
 1. An optical touch detection system comprising: atouch sensitive area within which touch events are to be detected;emitters and detectors arranged around a periphery of the touchsensitive area, the emitters producing optical beams received by thedetectors, wherein touch events disturb the optical beams; and anoptical control system coupled to the emitters and detectors, theoptical control system configured to: control activation of a pluralityof the emitters and detectors simultaneously according to a modulationscheme that modulates each optical beam with a different function,wherein to control of activation of the emitter and detectorcorresponding to at least one of the optical beams the optical controlsystem is further configured to: apply a variable timing mechanism tothe function modulating the beam; activate and deactivate the emitterand detector corresponding to the beam according to the variable timingmechanism applied to the function; and correlate output from thedetectors regarding which optical beams have been disturbed by a touchevent with the different functions to determine a location within thetouch sensitive area where the touch event occurred.
 2. The opticaltouch detection system of claim 1 comprising a noise detection mechanismconfigured to sample detector output before and after emitter activationto determine a noise level before and after activation.
 3. The opticaltouch detection system of claim 2 wherein the noise detection mechanismis further configured to interpolate a noise level during emitteractivation based on the noise level before and after activation.
 4. Theoptical touch detection system of claim 3 wherein the noise detectionmechanism is further configured determine energy incident on thedetectors based on detector output sampled during emitted activation andbased on the noise level during emitter activation.
 5. The optical touchdetection system of claim 3 wherein the noise level during emitteractivation is used to determine an emitter power level.
 6. An opticaltouch detection system comprising: a touch sensitive area within whichtouch events are to be detected; emitters and detectors arranged arounda periphery of the touch sensitive area, the emitters producing opticalbeams received by the detectors, wherein touch events disturb theoptical beams; and an optical control system coupled to the emitters anddetectors, the optical control system configured to: control activationof a plurality of the emitters and detectors simultaneously according toa modulation scheme that modulates each optical beam with a differentfunction, each function having a code length during which the emittercorresponding to the beam is intermittently activated and deactivated,the functions collectively configured to reduce a variation in a numberof emitters that are active simultaneously during the code length; andcorrelate output from the detectors regarding which optical beams havebeen disturbed by a touch event with the different functions todetermine a location within the touch sensitive area where the touchevent occurred.
 7. An optical touch detection system comprising: a touchsensitive area within which touch events are to be detected; emittersand detectors arranged around a periphery of the touch sensitive area,the emitters producing optical beams received by the detectors, whereintouch events disturb the optical beams; and an optical control systemcoupled to the emitters and detectors, the optical control systemconfigured to: control activation of a plurality of the emitters anddetectors simultaneously according to a modulation scheme that modulateseach optical beam with a different function, each function having a codelength when the function is applied to the corresponding emitter andhaving at least one activation period for the corresponding emitter,wherein the optical control system is further configured to controlactivation of the detector corresponding to the beam to: sample a firstdetector output during the code length before the activation period;sample a second detector output during the activation period; sample athird detector output during the code length after the activationperiod; and correlate output from the detectors regarding which opticalbeams have been disturbed by a touch event with the orthogonal functionsto determine a location within the touch sensitive area where the touchevent occurred.
 8. The optical touch detection system of claim 7,wherein the optical control system is further configured to interpolatea noise estimate during the activation period based on the first andthird detector outputs.
 9. The optical touch detection system of claim8, wherein the optical control system is further configured to inhibitactivation of the emitters and detectors responsive to the noiseestimate exceeding a threshold.
 10. The optical touch detection systemof claim 8, wherein the optical control system is further configured todetermine a signal attributable to emitters by subtracting the noiseestimate from the second detector output.
 11. The optical touchdetection system of claim 8, wherein the optical control system isfurther configured to compare the noise estimate with the correlatedoutput from the detectors to determine a signal to noise ratio betweenthe emitter and detector corresponding to the beam.
 12. The opticaltouch detection system of claim 11, wherein the optical control systemis further configured to control a power of the emitter based on thesignal to noise ratio.
 13. The optical touch detection system of claim7, wherein each function is orthogonal with respect to every otherfunction.
 14. The optical touch detection system of claim 7, wherein thefunctions are differentiated using amplitude modulation.
 15. The opticaltouch detection system of claim 7, wherein at least one of saiddetectors is positioned to receive optical energy from more than one ofsaid optical emitters.
 16. The optical touch detection system of claim7, wherein disturbing an optical beam comprises changing an amount ofenergy received at least one detector relative to an amount of energytransmitted from at least one emitter.
 17. The optical touch detectionsystem of claim 7, wherein each of the modulation functions keeps atleast a minimum number of emitters simultaneously active to reduce acurrent consumption in the optical touch detection system.
 18. Theoptical touch detection system of claim 7, wherein each of themodulation functions keeps less than a maximum number of emitterssimultaneously active to reduce a dynamic range of light levels receivedat a detector.
 19. The optical touch detection system of claim 7,wherein the modulation functions are non-periodic functions.
 20. Theoptical touch detection system of claim 7, wherein the optical controlsystem comprises a memory configured to store the modulation functions,and a drive circuitry configured to access the modulation functions andto control the operation of the emitters and detectors based on themodulation functions.
 21. The optical touch detection system of claim 7,wherein the optical control system comprises a variable timing mechanismconfigured to vary a modulation function with a non-periodic frequency.22. The optical touch detection system of claim 21, wherein the variabletiming mechanism is further configured to vary sampling of detectoroutput according to the non-periodic frequency.